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LISRAklES 

BAYES  MARKOVIAN  DECISION  MODELS  FOR  A  MULTISTAGE 
REJECT  ALLOWANCE  PROBLEM 

by 


Leon  S,  White 

The  Sloan  School  of  Management 
Massachusetts  Institute  of  Technology 


1.   Introduction 

Consider  the  situation  where  a  production  system  is  required  to  have 
a  given  number  of  non-defective  items  available  for  shipment  at  a  specified 
future  time.  When  the  production  time  span  can  be  broken  up  into  a  sequence 
of  periods  and  when  the  production  process  is  assumed  to  be  perfect  (no 
defectives  are  produced),  then  the  production  planning  problem  can  be 
viewed  in  terms  of  allocating  a  scarce  resoiupce  (produced  items)  to  the 
several  periods  [9],  The  optimal  production  schedule  will  depend  on  the 
production  cost  function  and  inventory  storage  cost  in  each  period,  and 
possibly  on  the  costs  of  changing  production  rates  from  period  to  period. 

A  production  process,  however,  is  most  often  imperfect  and  sometimes 
the  production  time  span  is  not  naturally  divided  into  periods.   When  the 
first  or  both  of  these  conditions  hold,  the  production  planning  problem 
becomes  one  of  scheduling  production  in  excess  of  the  required  amount  so 
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that  a  sufficient  number  of  non-defective  items  will  be  available  for 
shipment.  The  excess  production  is  termed  the  reject  (scrap  or  shrinkage) 
allowance « 

The  reject  allowance  problem  was  first  formulated  as  a  static  problem 
in  which  an  optimal  production  rate  is  determined  prior  to  the  period  of 
production  and  the  output  is  inspected  after  production  is  completed. 
Bowman  [1],  in  an  early  study,  approached  the  problem  under  the  assumption 
that  process  quality  is  independent  of  the  number  of  units  produced.   Goode 
and  Saltzman  [6]  and  Hillier  [7]  have  also  made  this  assumption  in  connec- 
tion with  a  different  version  of  the  static  problem.   On  the  other  hand, 
Giffler  [5]  and  Levitan  [10]  have  approached  the  static  problem  under  the 
assumption  that  process  quality  is  a  function  of  the  production  rate. 

Klein  [8],  in  a  recent  paper,  seems  to  have  been  the  first  to 
formulate  dynamic  (multistage)  versions  of  the  reject  allowance  problem. 
He  assumed  that  inspection  can  be  performed  at  intermediate  points  within 
the  production  time  span  as  well  as  at  the  conclusion  of  production.   In 
one  model  the  time  span  is  divided  into  a  fixed  number  of  subspans  (stages) 
not  necessarily  of  equal  length.   This  would  be  the  case  where  the  time 
span  could  be  divided  into  a  sequence  of  periods  when  (say)  the  needed 
equipment  was  available.   In  a  second  model,  the  number  and  length  of  the 
stages  are  random  variables.   In  the  first  model,  the  stages  are  assumed 
to  be  independent  in  the  sense  that  process  quality  in  any  stage  is  taken 
to  be  a  function  only  of  that  stage  and  the  amount  produced  during  the 
stage.   In  the  second  model,  the  probability  of  producing  a  defective  in 
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in  any  stage  is  assumed  to  be  a  function  of  the  number  of  items  previously 
produced,  the  cumulative  number  of  non-defectives  and  the  number  of  items 
produced  during  that  stage.   In  this  model,  the  costs  of  production, 
inspection,  storage,  and  the  excess  and  shortage  charges  are  also  functions 
of  this  data.   In  the  first  model,  these  costs  are  related  to  the  stage, 
the  cumulative  number  of  non-defectives,  and  the  production  rate  for  the 
stage.  Thus  in  both  models,  the  functions  describing  process  quality  and 
costs  are  quite  general.   Using  the  theory  of  Markovian  sequential  decision 
processes  as  developed  by  Derman  [2],  [3]  and  Derman  and  Klein  [U],  Klein 
shows  that  optimal  decision  rules  for  scheduling  production  for  both  models 
may  be  determined  by  linear  programming  methods.   In  addition,  he  shows 
how  the  linear  programming  formulation  allows  for  the  inclusion  of  various 
side  conditions. 

The  general  multistage  models  for  the  reject  allowance  problem  that 
Klein  has  formulated  are  left  open  to  specific  interpretation.   In  this 
paper  we  define  a  particular  reject  allowance  problem  and  analyze  several 
versions  of  it  using  Klein's  models  and  some  fundamental  notions  of 
statistical  decision  theory  [11],  [12],  as  starting  points.  The  problem 
we  shall  consider  arises  when  constraints  on  equipment  and  manpower 
(hereafter  referred  to  as  production  capacity)  are  specified  prior  to  the 
start  of  production.   In  the  first  model,  production  capacity  is  specified 
(or  determined)  at  the  beginning  of  production  and  remains  fixed  for  the 
entire  run.   The  model  can  be  described  as  a  Bayesian  multistage  analog  to 
Bowman's  problem.   In  the  second  model,  there  is  an  upper  bound  on  production 
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capacity, but  after  the  start  of  production  the  actual  production  rate 
may  be  increased  or  'decreased  at  specified  future  times  (possibly  at  a 
cost)o  This  model  can  be  viewed  as  a  Bayesian  analog  to  Klein's  first 
model. 


2.   A  Bayes  Markovian  Decision  Model  for  Fixed  Capacity 

Suppose  that  an  order  for  I  items  is  required  for  shipment  at  a  known 
future  date.  At  the  start  of  production  a  certain  amount  of  production 
capacity  K,  K  -  I,  is  available.   The  quality  of  produced  items  is  assumed 
to  be  stable  in  the  sense  that  the  production  process  is  viewed  as  a 
Bernoulli  process  [11]  with  parameter  p,  the  probability  of  producing  a 
defective.   It  will  not,  however,  be  assumed  that  p  is  known.   Instead, 
p  will  be  considered  a  random  variable   (in  the  Bayesian  sense)  with  a 
prior  density  function  f„ ( ° j i  ,r  )  from  the  beta  family,  where 


(2.1)         f^(pL^.rQ)  =.^^-^^y^.^--_^  (l-p)    p 


iQ.r^  =  0,1,2,...,   0  -  p  -  1, 


Following  Raiffa  and  Schlaifer  [12]  we  denote  random  variables  with 
tildes,  e.g.,  the  random  variable  corresponding  to  the  parameter  p  is 
written  p. 
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Under  the  fixed  capacity  assumption,  Klein's  second  model  which 
provides  for  an  arbitrary  number  of  inspection  points  (stages)  seems  most 
appropriate.   This  model  allows  information  to  be  accumulated  during  the 
production  run^   The  information  is  used  to  determine  the  cumulative 
number  of  non-defectives  produced  thus  far  and  to  revise  judgment  about 
the  distribution  of  p  via  Bayes'  theorem »   The  cumulative  number  of  non- 
defectives  and  the  posterior  distribution  of  p  are  then  used  in  our 
adaptation  of  the  model  to  find  the  optimal  number  of  items  to  produce 
before  the  next  inspection «  Actually,  the  linear  programming  formulation 
for  this  problem  allows  the  optimal  sequence  of  production  levels  to  be 
determined  simultaneously » 

Klein's  second  model,  particularized  to  allow  for  our  Bayesian 
interpretation,  is  formulated  as  follows.   At  any  time  during  the 
production  run,  the  production  results  thus  far  can  be  described  by  the 
number  of  items  produced  r,  r  =  0,1,-,  ,o,K,  and  the  number  of  non-defectives, 
i  ,  among  the  r  items.   Thus,  the  observed  evolution  of  the  production 
process  can  be  described  in  terms  of  the  state  space  S  where 

S  =  {i^ti     -   r,  r=0,l,o 0 , ,K} , 

K  being  the  fixed  production  capacity »   The  process  always  begins  in  state 
Oq.   At  the  end  of  the  first  stage,  the  process  will  be  in  state  j   if  the 


Wherever  possible  we  retain  the  notation  of  Klein  [8], 
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first  production  decision  resulted  in  the  production  of  x  items  and  j   of 
these  were  found  to  be  non-defective,,   The  process  will  continue  to  evolve 
in  this  way  until  state  i   is  reached  or  until  it  is  decided  to  stop 
production  0 

As  in  [8],  each  decision  by  which  x,  the  number  of  units  to  produce, 
is  chosen  may  be  a  randomized  decision  over  the  possible  values  of  Xo 
Letting  d(i  ,  x)  represent  the  conditional  probability  of  selecting  produc- 
tion level  X  given  that  the  process  is  in  state  i  ,  we  denote  any 
randomized  decision  rule  by  a  matrix  D  with  elements 


d(i^.x)  ^  0, 


and  such  that 


K-r 

E   d(i  ,x)  =  1, 

x=0    r 


Now  let  {y  :n=l,2,„  »  « s,N+l}  denote  the  sequence  of  states  observed  at 

the  start  of  stages  n=l,25ooo5N;  y-    denotes  the  final  state  of  the 

N+1 

processo   (Note  that  N  is  a  random  variable  through  its  dependence  on  Do) 
Also,  let  {A  :n=l,2, , „ „ gN}  denote  the  sequence  of  production  decisions. 
Then  we  define 


(2,2)         q..(r,x)  =  P{y  .,=j    ly  =i^sA  =x}5    n=l,2,»»o,No 
1]         -'n+1  r+x  n  r'  n 

Thus,  q..(r,x)  denotes  the  probability  that  (j-i)  additional  non-defectives 
will  result  from  the  production  of  x  additional  items,  x  -  K-r»  Therefore, 
when  P{y  =0  }  =  1  and  any  decision  rule  D  is  used,  the  sequence  of  observed 
states  {y  }  is  a  Markov  chain  with  stationary  transition  probabilities 
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P(ir,»ig)  =  d(ij^,x)q^j(r,x),  s  =  r+x,  i^  c  S-T, 

where 

T={i:i  -Iorr=K} 
r  r 

represents  the  set  of  "stopping"  states.  We  make  the  Markov  chain  cyclical 
by  setting 

q.Q(r,0)  =1,  i^  e  T 

so  that 

pCi^.Oq)  =1,  i^  e  T. 

Also,  to  take  care  of  the  situation  where  the  decision  to  terminate 
production  precedes  entry  into  a  stopping  state,  we  let 


and  thus 


q.Q(r,0)  =  1,  i^  e  S-T 


P^^r»°0^  =  d(i^,0),  i^  z    S-T. 


At  this  point  we  introduce  a  Bayesian  approach  to  the  evaluation  of 
q- -(rjx),  i  e  S-T,  j    e  S,  x  >  0„   First  note  that  if  p,  the  probability 
of  producing  a  defective  is  assumed  to  be  known,  then  (j-i)  would  have  a 
binomial  distribution  with  parameters  x  and  p,  i.e.,, 

q^j(r,x)  H  f^(j-i|p,x)  E  (j-i)  (l-p)^'"^p''  ^^^ , 
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However,  we  have  assumed  p  to  be  a  random  variable  with  a  beta  prior  given 
by  equation  (2,l)o   The  "sampling  process"  (producing  x  items  and  finding 
j-i  non-defectives)  is  binomial  and,  consequently,  qQ,(0,x)  is  a  beta- 
binomial  mass  function  for  j  (see  Raiffa  and  Schlaifer  [12],  page  255) 
where , 

qQj(0,x)  H  /Qf^(j|p,x)fg  (p|iQ,rQ)dp,    x  =  1.2,,oo,K;  j  ^  Xc 

Moreover,  using  Bayes'  theorem,  it  can  be  shown  that  in  general, 

(2.3)   q.j(r,x)  =  /Jfj^(  j-i]  p.x)fg  (p|  iQ+i.rQ+r)dp,  i^  e  S-T,j^^  e  S;  x  >  0. 

(j+iQ-l)!(rQ+r+x-j-io-l)!  x!(rQ+r-l)! 
""    (j-i)!(iQ+i~l)»(x-j-i)!(rQ+r-iQ-i-l)!(rQ+r+x-l)! 

The  second  expression  appears  in  Raiffa  and  Schlaifer  [12],  page  237 . 

Now  for  fixed  capacity  K,  let  c(ij^,x)  denote  the  total  cost  of 
producing  and  inspecting  x  items  and  storing  i^^  items  during  this  stage 
of  production.   If  i  e  T  or  x  =  0,  then  c(i  ,x)  also  includes  the  cost 
of  excess  if  i  >  I  or  shortage  if  i  <  I,  and  the  remaining  storage  costs 
until  the  date  of  shipments 

The  description  of  the  fixed  capacity  problem  is  now  complete.   Using 
the  results  of  Derman  [2],  we  can  formulate  the  problem  as  a  linear 
programs 
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The  solution  to  the  linear  program  is  then  used  to  find  the  optimal  decision 
rule.   (As  pointed  out  in  [U],  [8],  the  problem  could  also  be  formulated 
as  a  dynamic  programs ) 

The  linear  program  to  be  solved  is  given  by: 


Minimize:     Z  =  E  I  z(i  ,x)c(i  ,x) 

i  X     ^      ^ 


Subject  to:    z(j  ,x)  -  0,     j^  e  S,  x  =  O,l,„o,,k-s; 

s  s 


z(''0  -  0 


l   E  z(j^.x)  -  z(*)    =  0 

1     X 

s 


I   z(j^,x)  -  i:   z(i^,s-r)  q^  (r,s-r)  =  0,      j  -  i»  s  -  r,  j^  e  S-O^; 


I   z(0  ,x)  -   E    E  z(i  ,x)  =  0 
X    0      i  eT  X    ^ 
r 


T.   z(0^,x)  =  1, 
X    0* 


The  elements  of  the  optimal  decision  rule  are  computed  as 


d(i  ,x)  =  ,  .  .,  ., 

'^  T.   z(i  ,x) 
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If  the  denominator  is  zero  then  the  value  of  d  may  be  set  arbitrarily 
without  changing  the  expected  minimum  costo 

It  might  be  assumed  that  prior  to  the  start  of  production  several 

different  production  capacities  are  available  rather  than  just  one»   In 

this  case,  let  K  denote  the  set  of  capacities  and  C(K),  Ke  K  »  the 
0  0 

costs  related  to  operating  at  capacity  Ko  Then  the  optimal  capacity  K* 
could  be  determined  by  sowing  the  equation 


C(K''0  =  Min   {c(K)  +  Z(K)} 
KeK. 


where  Z(K)  is  the  linear  programming  solution  for  capacity  K, 


3c   A  Bayes  Markovian  Decision  Model  for  Variable  Capacity 

In  this  section  we  assume  a  maximum  production  rate  k„   We  also 
assume  that  the  actual  production  rate  x*,  x'  -  k,  may  be  increased  or 
decreased  at  N-1  fixed  points  during  the  production  time  spano   Let  t  « 
n  =  1,2,0  0  0,  N  denote  the  length  of  the  n^   stage.   Then  the  maximum 
number  of  units  that  can  be  produced  in  stage  n  is  given  by  K  where 

K  =  kt  0 
n     n 

The  actual  number  produced  will  be  given  by  x  ,  x  "  K  ,   Thus  the  production 
rate,  x',  for  stage  n  is  given  by 

x'  =  X„/t„o 

n    n  n 
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Finally,  we  shall  assume  that  the  cost  of  changing  production  rates 
from  stage  n  to  n+1  is  given  by  the  known  function 

h(x' ,x'   ),  n  =  1.8, .,N;  x',x'  ,  -  k. 

n  n+1  »   '  '  n'  n+1 


As  an  example  of  where  the  variable  capacity  model  might  apply  consider 
the  case  where  production  equipment  is  rented  for  fixed  periods  of  time 
(e.g.,  by  the  week  or  month),  and  where  decisions  on  changing  capacities 
are  made  at  the  end  of  each  rental  period.   The  assumption  of  an  upper 
limit  on  capacity  could  result  from  a  limit  on  available  skilled  labor  or 
from  a  limit  on  available  floor  space « 

In  order  to  describe  the  evolution  of  the  production  process  for  the 
variable  capacity  problem,  we  specify  the  state  space 


S  =  t(r^_i.x^_^,i^)sx^_i  ^  VliV 


n-2       ^ 

I       x.;i  -  r  ,+x  , ;n  =  1,2, , , » ,N+1} , 
.  ,   ]   n    n-1  n-1 


where  i    is  the  cumulative  number  of  non-defectives  produced  during  N 
stages  and  where  r   =  r^  =  x  =  i,  =  0»   (Note  that  r  denotes  the 
cumulative  number  of  items  produced  during  the  first  n-1  stages,  i.e,, 
r^  =  r  _i+x_._i»)  To  make  the  state  notation  slightly  less  cumbersome  let 
i-^  ^(.n)    =  (r   ,  ,x  ,,  i  );  thus,  for  example,  the  starting  state  (0,0,0) 
is  denoted  0   n^-'-^' 


.  I- 
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Again  we  allow  for  randomized  decision  rules  D  with  elements  now 

written  as  d(i   (n),x  )»  n  =  Ijooo.No   Also  as  before  we  let 
r,x   '  n  '      »    • 

{y  ;n=l,2 J  0 0 0 ,N+1}  denote  the  sequence  of  observed  states  and 

{A  sn=l,2,<,  0  0  ,N} ,  the  sequence  of  production  decisions »   Then  similar  to 

equation  (2„2)  we  define 

(3.1)  q..(r„,x  )  H  P{y   =j    (n+l)|y^=i    (n),  r^  = 

i:   n*  n       n+1  r,x     '  n  r,x   *   n 

r   +x   ,A  =x  } ,  n  =  l,2,o,o,N+l„ 

n=l  n-1  n  n 

Thus,  when  P(y-  =  0„  ^(1))  =  1  and  any  rule  D  is  used,  the  sequence  {y  } 
1    0 jO  "  n 

is  a  Markov  chain  with  stationary  transition  probabilities, 

Pl^^r.x^")'  ^'r.x^"-"^^^  =  ^^^r.x^"^»''n^^ij^''n»''n^»        "  =  l»2»o«»,N, 
To  return  the  process  to  its  starting  state  we  set 

p[i   (n+1),  Oq  ^(1)]  =  1,       all  i^  j^(n+l)» 

Then  {yj^;m=l,2, ,  » ,  ;  where  for  m  >  N+1,  m=n  mod(N+l),  n=l,2, »  , » ,N+1}  is  a 
cyclical  Markov  chain  with  one  ergodic  class  of  states o 

To  give  the  variable  capacity  model  a  Bayesian  interpretation  we  again 
characterized  the  production  process  as  a  Bernoulli  process  with  unknown 
parameter  p.   Then  if  p  is  assumed  to  have  a  beta  prior,  equation  (2ol), 
with  parameters  i  and  r,  q..(r  ,x  )  is  evaluated  as, 

(3o2)  ^ij^^n'^^n^  =  -^X^^n+r^nl  P'^^n^^B^P  I  ^^^n'^-^^n^^P* 
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The  solution  of  the  integral  in  equation  (3„2)  has  been  given  in  equation 
(2,3). 

The  cost  associated  with  the  n   stage  of  the  process  is  denoted  by 

c(i   (n)»x  )»  n  =  l,2,oo..N+l.   This  cost  for  n  -  N  will  be  the  sum  of 
r,x     n 

the  costs  of  producing  and  inspecting  x  items,  the  cost  of  storing  i 

items  for  time  t  ,  and  the  cost  of  changing  the  production  rate, 

h(x'   ,x  ),   For  n  =  N+1,  c(i^  ,,(^+1)  »Xm4.i  )  denotes  the  excess  or  shortage 
n-1  n  "»''       ^^'''•'■ 

cost  associated  with  the  total  production  of  i   .  non-defective  items „ 

The  Bayes'  variable  capacity  model  described  above  includes  aspects 
of  both  of  Klein's  models,  [8],   Its  formulation  as  a  linear  program  is 
similar  to  that  of  Klein's  first  model  and  follows  from  Derman  and 
Klein  [U],   The  linear  program  is  written  as; 

Minimize:       Z  =  (N+DIZ.  /--lE   z(i„  ^(n),x  )c(i^  v(n),x  ) 

Subject  to:     z(i„  ^(n),x„)  -  0,    all  i^  ^(n)  e  S,  x^  -  K  ; 


(3.3)    I 


z(j    (n+l),x^,-,)  -  I    ,      z(i   (n),x  )q..(r  ,x  )  =  0, 
^  ^r,x       n+1    ^  (n)   r,x   '  n  ij   n*  n 


r  aX 


i    (n+1)  e  S,      n  =  1,2,  t,  o  o  ,N-1 ; 
rjX 


Z  z(0^  AD^y.^)   -    .^,.,^.J-        z(i   (N+l).x,,^,  )  =  0; 
X    0,0     1    1  (N+l)x      r,x       N+1 

1  r,x    N+1 


E   E   E  z(i   (n),x  )  =  It 
n  i  (n)x    r,x     n 
r,x  n 


m  - 


As  before,  the  elements  of  the  optimal  rule  D  are  given  by 


d(i   (n),x  ) 


z(i^^^(n).x„) 


r,x 

3 

n 


n    E  z(i   (n),x  ) 


X    ^»x 


4,   Discussion 

Klein  [8]  has  shown  that  the  linear  programming  formulation  of  a 
multistage  reject  allowance  problem  allows  for  the  possibility  of  including 
certain  side  conditions,   Thus,  in  our  second  model,  for  example,  if  it 
were  desired  that  the  expected  number  of  non-defectives  produced  in  the 
first  m-1  periods,  m  =  2,ooo,N+l,  be  greater  than  I  ,  we  could  include 
this  condition  by  adding  the  constraint 

(4.1)  (N+1)   E,  ,z(i    (m),x  )i   >  I 

i  (m)   r,x   'mm    m 

r  ,x 

to  the  linear  program  (3o3).   Derman  [2]  has  shown  that  the  linear 
programming  solution  to  a  Markovian  decision  model  with  no  side  conditions 
always  leads  to  a  non-randomized  optimal  decision  ruleo   But  when  side 
conditions  are  added,  the  optimal  rule  may  be  randomized. 

However,  whether  or  not  the  optimal  rule  is  randomized,  it  may  be 
very  difficult  to  calculate.   This  is  due  to  the  fact  that  the  linear 
program  associated  with  a  Markovian  decision  model  is  often  unreasonablv 
large.   In  some  cases,  it  may  be  possible  to  use  decomposition  methods  [14] 
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to  overcome  this  "curse  of  dimensionality,"   In  other  cases,  the  nature 
of  transitions  from  state  to  state  plus  the  form  of  the  objective  function 
may  allow  for  a  reduction  of  the  state  space,  [13], 

It  is  clear  in  the  present  case  that  both  of  our  models  can  lead  to 

computational  difficulties.  As  a  way  to  reduce  the  number  of  states  in 

the  first  model,  one  could  limit  production  decisions,  x,  to  be  multiples 

of  a  basic  production  level  (number  of  units)  x. .   Thus,  for  example,  if 

X  =  10  units,  X  is  chosen  from  the  set  {10,  20,  30}  and  K  =  30,  then  the 
0 

state  space 

S  =  (0^,  10^,  ...,  lO^Q.  20^,  ,..,  2O2Q.  30^,  ...,  30^^} 

would  obtain „  This  state  space  would  include  64  states  rather  than  U96o 

The  idea  of  limiting  decisions  to  multiples  of  a  basic  production 
level  may  be  valid  when  it  is  only  feasible  (or  practical)  to  conduct 
inspections  at  equally  spaced  time  intervals,  e<,go,  at  the  end  of  each 
weeko   The  basic  production  level  would  then  correspond  to  a  week's 
production. 


In  general  the  reduction  would  be  from  (K+l)(K-f-2)  states  to 

2 

1/ 

1  +  ^  [K+x^+2]  when  —  is  an  integer, 
2x      "^         X 

''o  0 
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In  the  second  model  it  might  be  possible  to  justify  the  use  of  a 

basic  production  rate  x'  in  determining  the  set  of  production  decisions  to 

0 

be  considered.   The  production  decision  in  each  period  would  then  be 
limited  to  integer  multiples  of  this  rate  within  capacity  restrictions, 

The  Bayesian  approach  seems  very  natural  in  relation  to  our  models. 

In  fact,  it  should  be  possible  to  give  a  Bayesian  interpretation  to  any 

Markovian  decision  model  in  which  the  states  represent  accumulated 

information  from  the  system o   As  another  example,  consider  the  following 

sketch  of  a  simple  "stopping  rule"  problem.   Suppose  a  machine  is  set  up 

to  produce  K  items ;  after  the  K   item  is  produced  the  machine  must  be 

broken  down  and  set  up  again.   After  each  set  up  the  machine  will  produce 

defectives  at  a  rate  p  if  set  up  correctly  and  a  rate  p_  >  p,  otherwise. 

Let  the  states  of  the  Markovian  decision  model  be  given  by 

{i  :i  <  r;r  =  0,  o..,  K}  where  r  is  the  number  of  produced  items  and 

i  the  number  of  non-defectives  since  the  last  set  upo   To  keep  things 

simple,  suppose  that  after  every  x   items  are  produced  it  must  be  decided 

either  to  reset  the  machine  or  to  produce  x  additional  items  under  the 

0 

present  set  up. 

The  problem  may  be  formulated  in  terms  of  minimizing  the  average  cost 

of  setup,  production  and  repair  per  unit  produced  and  the  Bayesian  analysis 

would  enter  into  the  evaluation  of  the  probability  of  going  from  state  i  to 

jjo+v  given  the  decision  is  to  produce  x  items.   If  we  let  f'(p,)  and 

0 
f'(p  )  be  the  prior  probabilities  associated  with  p-,  and  p  and  define 
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q.  (r,x  )  as  in  equation  (2,2),  we  would  have 
i:    0 


q..(r.XQ)  =  qij(r.xjp^)  P(pji^)  +  ^^^(^^^o^?^^   Hp^\i^) 


r'+Xp.-J 

=  c[(i-p^)^  P^^+^o-:  f.(p^)  +  (i-p^)^  p^     f'(P2)] 


where  C  is  a  normalizing  constant  independent  of  p^  and  p^.   The  values 
of  q..(r  •)  corresponding  to  the  decision  to  reset  the  machine  would  be 

q.pCr.O)  =1,      i  -  0,  r  -  K 

q^j(r,0)  =  0,      i,j  -  0,  r  ^  K. 

The  linear  programming  formulation  would  be  similar  to  the  one  used  with 
our  first  model. 
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